System and method for presenting prioritized advertising data in a picture in picture display window during execution of video trick play command data

ABSTRACT

A computer readable medium is disclosed containing computer executable instructions that when executed by a computer perform a method, the method including but not limited to receiving trick play command data at an end user device; receiving a advertising data at the end user device; correlating the advertising data with penetration data for an end user associated with the end user device; prioritizing the advertising data for the end user device based on the correlation; and presenting a portion of the advertising data in a picture in picture display window on the end user device based on the prioritizing of the advertising data during execution of the trick play command data. A system is disclosed that is useful in performing the method. A data structure embedded in a computer readable medium is disclosed that contains data used by the system and method.

FIELD OF THE DISCLOSURE

The present invention relates to the field of targeted advertising datapresentation during the execution of trick play video command data.

BACKGROUND OF THE DISCLOSURE

Targeted advertisements have historically been mailed to large targetedgeographic areas such as a particular city, so that regional advertisersreach only persons who are deemed by the advertiser as most likely to beresponsive to their advertisements.

Advertisements are a component in digital video services, including liveor pre-recorded broadcast television (TV), special or pay-per-viewprogramming, video on demand (VOD), and other content choices availableto subscribers.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an illustrative embodiment of a system for presentingprioritized advertising data and monitoring data sent and received byvarious subscriber devices associated with a subscriber for monitoringadvertising impression quality factors data and to estimate penetrationfor the advertising data and end users associated with video datapresentation devices;

FIG. 2 depicts a flow chart for functions performed in anotherillustrative embodiment for delivering priority advertising data tosubscribers during playback of video data on a video data presentationdevice in a communication system, such as an IPTV system;

FIG. 3 depicts end user connectivity relationships between end userdevices associated with end users in an illustrative embodiment;

FIG. 4 depicts a flow chart for functions performed in anotherillustrative embodiment for monitoring data sent and received by varioussubscriber or end user devices associated with end users or subscribersin a communication system, such as an IPTV system;

FIG. 5 depicts a data structure embedded in a computer readable mediumthat is used by a processor and method for delivering advertising data;

FIG. 6 depicts a data flow diagram for functions performed in anotherillustrative embodiment for monitoring data sent and received by varioussubscriber devices associated with subscribers in a communicationsystem, such as an IPTV system;

FIG. 7 depicts a flow chart for functions performed in anotherillustrative embodiment for delivering prioritized advertising databased on monitoring of data sent and received by various subscriberdevices associated with subscribers in a communication system, such asan IPTV system;

FIG. 8 depicts a flow chart for functions performed in anotherillustrative embodiment for presenting prioritized advertising data in aPIP window based on monitoring data sent and received by varioussubscriber devices associated with subscribers in a communicationsystem, such as an IPTV system;

FIG. 9 depicts a flow chart of functions performed in an illustrativemethod for presenting prioritized data in a PIP window;

FIG. 10 depicts a flow chart of functions performed in anotherillustrative method for delivering advertising data;

FIG. 11 is an illustration of an illustrative embodiment of anadvertising data item display in which the prioritized advertising dataitem is displayed on a main screen during trick play and a PIP displayafterwards;

FIG. 12 is an illustration of an illustrative embodiment of anadvertising display in which a plurality of prioritized advertising dataitems are displayed on a main screen during trick play and a picture inpicture and rotated through the main screen display;

FIG. 13 is an illustration of a data structure embedded in computerreadable medium; and

FIG. 14 depicts an illustrative embodiment of a machine for performingfunctions disclosed in an illustrative embodiment.

DETAILED DESCRIPTION

An illustrative embodiment provides a digital video recorder (DVR)interface wherein a video data presentation system such as a set top box(STB) and video display or DVR and video display, that presentsalternative advertising data during execution of trick play commands onthe DVR, STB or other video presentation system controller. Trick playcommand data are issued by an end user using a remote control (RC)associated with the DVR, STB or other video presentation system. Trickplay command data include but are not limited to trick play command dataindicative of fast forward, rewind, skip forward, etc. commands to thevideo data presentation system. In another illustrative embodiment,advertising data is prioritized so that during execution of the trickplay command data at the DVR, STB or other video presentation system,the advertising data is presented in prioritized order. In anotherparticular embodiment, a single prioritized advertising data item (alsoreferred to as an advertisement) is presented during trick play commanddata execution. In another particular embodiment, advertising data isprioritized based on penetration data for advertising data types forparticular end users.

Prioritized advertising enables advertisers to target their specificmarket based on the programs that are available and based on the endusers whom are watching the programs. For example, beer companiesprioritize commercials to be played during football games because theybelieve that their target audience will be drinking beer and watchingfootball at that time. While this may work well for beer companies,other advertisers, with a less predictable target behavior may be in aprecarious position considering their products. An example of this mightbe a situation comedy where the characters go to a particular carmanufacturer's dealership to buy a new car. Another illustrativeembodiment identifies with the advertising data the car manufacturer'sname and queues a prioritized commercial for the car manufacturer duringthe commercial break that was previously downloaded from the advertisingdata management system. This allows companies to prioritize advertisingdata for their products within programs and advertise for those productsto selected end users or subscriber and at a time when the subscribersare most likely to retain their thoughts concerning those products.

With the growing average number of TVs per household, and the growingplacement of products within programs, there is significant need for anintelligent model to deliver advertising. This solution allowsadvertisers to prioritize their commercials in a time slot that allowsfor maximum retention by TV viewers. It also allows service providers toprofit by charging advertisers for each playback of their content. Withtwo-way communication to the receiver, a service provider can determinehow many times a specific commercial was played and charge theadvertiser a fixed price/playback.

In another embodiment, a computer readable medium is disclosedcontaining computer executable instructions that when executed by acomputer perform a method, the method including but not limited toreceiving trick play command data at an end user device; receiving aplurality of advertising data at the end user device; correlating theplurality of advertising data with penetration data for an end userassociated with the end user device; prioritizing the advertising datafor the end user device based on the correlation; and presenting aportion of the advertising data on the end user device based on theprioritizing of the advertising data during execution of the trick playcommand data. In another embodiment of the medium the advertising datafurther includes but is not limited to advertising data keys.

In another embodiment of the medium the penetration data furtherincludes but is not limited to at least one data set selected from thegroup consisting of advertising forwarding data and advertisingdiscussion data for the end user. In another embodiment of the mediumthe penetration data further comprises penetration effectivity databased on impression quality factors for the advertising data forwardedby the end users. In another embodiment of the medium the correlatingfurther comprises finding a penetration data category that matches oneof the advertising data keys. In another embodiment of the medium theadvertising data further comprises penetration category data forcorrelating with subscriber activity data for the end user.

In another illustrative embodiment, a system is disclosed, the systemincluding but not limited to a processor in data communication with acomputer readable medium; and a computer program embedded in thecomputer readable medium comprising computer executable instructions forexecution by the processor, the computer program comprising instructionsto receive trick play command data at an end user device, instructionsto receive a plurality of advertising data at the end user device,instructions to correlate the plurality of advertising data withpenetration data for an end user associated with the end user device,instructions to prioritize the advertising data for the end user devicebased on the correlation and instructions to present a portion of theadvertising data on the end user device based on the prioritizing of theadvertising data during execution of the trick play command data.

In another embodiment of the system the advertising data furtherincludes but is not limited to advertising data keys. In anotherembodiment of the medium the penetration data further comprises at leastone data set selected from the group consisting of advertisingforwarding data and advertising discussion data for the end user. Inanother embodiment of the medium the penetration data further comprisespenetration effectivity data based on impression quality factors for theadvertising data forwarded by the end users. In another embodiment ofthe medium the instructions to correlate further comprise instructionsto find a penetration data category that matches one of the advertisingdata keys. In another embodiment of the medium the penetration datafurther comprises penetration category data for correlating withsubscriber activity data for the end user.

In another illustrative embodiment, a computer readable medium isdisclosed, containing a data structure for containing data useful insending advertising data the data structure including but not limited toa first field for containing data indicative of a trick play commanddata for execution at an end user device; and a second field forcontaining data indicative of prioritized advertising data based onadvertising penetration data for an end user associated with the enduser device for presentation at the end user device during execution ofthe trick play command data. In another embodiment of the medium, thedata structure further includes but is not limited to a third field forcontaining data indicative of the advertising penetration data for theend user associated with the end user device. In another embodiment ofthe medium, the data structure further includes but is not limited to afourth field for containing data indicative of advertising data key datafor correlation with the advertising penetration data for prioritizingthe advertising data.

In another embodiment of the medium, the data structure further includesbut is not limited to a fifth field for containing data indicative ofadvertising forwarding data for advertising data forwarded by the enduser at the end user device to other end user devices. In anotherembodiment of the medium, the data structure further includes but is notlimited to a sixth field for containing data indicative of advertisingdiscussion data for advertising data discussed by the end user at theend user device with other end users at other end user devices. Inanother embodiment of the medium, the data structure further includesbut is not limited to a seventh field for containing data indicative ofadvertising penetration category data for the end user device.

Another illustrative embodiment provides of a content controlapplication that provides two-way communication between a backendmanagement system, a backend server management system to serve contentto the receiver, and advertising data that is flagged with specificmetadata, including but not limited to advertising data keys. Duringoff-peak hours, the content control application communicates with thebackend management system and imports available advertising data. Thisadvertising data is then indexed on the content control application toallow for fast local content delivery. Once the content controlapplication has indexed the available advertising data it is ready forthat content to be played.

In a particular embodiment, a computer readable medium is disclosedcontaining computer executable instructions that when executed by acomputer perform a method, the method including but not limited tomonitoring video data for advertising data keys; correlating theadvertising data keys with penetration data for an end user; andprioritizing advertising data for the end user based on the correlationbetween the advertising data keys and the penetration data for the enduser. In another embodiment of the medium, in the method the penetrationdata further includes but is not limited to at least one data setselected from the group consisting of advertising forwarding data andadvertising discussion data for the end user. In another embodiment ofthe medium, in the method the penetration data further includes but isnot limited to penetration effectivity (PE) data based on impressionquality factors for the advertising data forwarded by the end users.Penetration data is a measure of an extent to which a particular enduser propagates advertising data to other end users. PE data is ameasure of how effective the penetration by the end user has been. PEtakes into account impression quality factors for a group of end usersto whom a particular end user propagates advertising data. Thus, PE is acombination of penetration data and impression quality factors.

In another embodiment of the medium, in the method the correlatingfurther includes but is not limited to finding a penetration datacategory that matches one of the advertising data keys. In anotherembodiment of the medium, in the method the closed captioning datafurther includes but is not limited to penetration category data forcorrelating with subscriber activity data for the end user.

In another embodiment, a system is disclosed including but not limitedto a processor in data communication with a computer readable medium;and a computer program embedded in the computer readable mediumincluding but not limited to computer executable instructions forexecution by the processor, the computer program including but notlimited to instructions to monitor video data for advertising data keys,instructions to correlate the advertising data keys with penetrationdata for an end user and instructions to prioritize advertising data forthe end user based on the correlation. In another embodiment of thesystem, the penetration data further includes but is not limited to atleast one data set selected from the group consisting of advertisingforwarding data and advertising discussion data for the end user. Inanother embodiment of the system, the penetration data further includesbut is not limited to penetration effectivity data based on impressionquality factors for the advertising data forwarded by the end users. Inanother embodiment of the system, the instructions to correlate furthercomprise instructions to find a penetration data category thatsubstantially matches one of the advertising data keys. In anotherembodiment of the system, the advertising data further includes but isnot limited to penetration category data for correlating with subscriberactivity data for the end user.

In another embodiment, a computer readable medium is disclosed,containing a data structure for containing data useful in prioritizingand presenting prioritized advertising data, the data structureincluding but not limited to a first field for containing dataindicative of members of a community of end users in a datacommunication system; and a second field for containing data indicativeof advertising penetration data for members of the community of endusers. In another embodiment of the medium, the data structure furtherincludes but is not limited to a third field for containing dataindicative of advertising penetration effectivity data for the membersof the community of end users. In another embodiment of the medium, thedata structure further includes but is not limited to a fourth field forcontaining data indicative of advertising data key data for selectingadvertising data from the advertising key data. In another embodiment ofthe medium, the data structure further includes but is not limited to afifth field for containing data indicative of advertising forwardingdata. In another embodiment of the medium, the data structure furtherincludes but is not limited to a sixth field for containing dataindicative of advertising discussion data. In another embodiment of themedium, the data structure further includes but is not limited to aseventh field for containing data indicative of advertising penetrationcategory data.

In a particular illustrative embodiment, a system and method aredisclosed for collecting penetration data for advertising data andestimating penetration effectivity (PE) indices for advertisement data,indicating not only which advertising data were forwarded and/ordiscussed by end users, but also impression quality factor indicatingbut not limited to how many devices upon which the advertising data wereviewed and for how long/which portions of the advertising data wereviewed, by which audiences and the effect the advertising data had onthe recipient audiences. Accurate advertising ratings can be madeavailable based on correlating program and advertising insertion datastored on video services servers (or embedded in content from videoservice providers) with subscriber activity logs which track customers'viewing behavior in some detail. In another embodiment, demographic dataon end users is correlated with advertising ratings at the aggregatelevel.

In another particular embodiment, a computer readable medium isdisclosed containing a computer program that when executed by aprocessor performs a method for estimating PE data for targetedadvertising data for end users (also referred to herein as “users” or“subscribers”) in a communication network, the computer programincluding but not limited to instructions to correlate impressionquality factors categories data with a subscriber activity data profilefor purchases and consumption related to an advertising category for theadvertising data for a group of end users to whom a first end userforwards advertising data or discusses advertising data; andinstructions to estimate from the correlation the PE in the advertisingcategory for an advertising data. In another particular embodiment ofthe medium the instructions to estimate the PE further compriseinstructions to add a reciprocal for a quality of impression for theadvertising data to strength of response (SOR) for the advertising data,wherein the SOR indicates a degree of impact on the subscriber in anadvertising category for the advertising data.

In another particular embodiment of the medium the impression qualityfactors categories data comprise combinations of impression qualityfactors data from at least two factors selected from the groupconsisting of subscriber device state data indicative of a degree ofactive advertising data viewing, subscriber type data indicative of atype of subscriber device receiving the advertising data, contentcharacter data indicative of a content character and subscriber typedata indicative of a type of subscriber viewing the advertising data.

In another particular embodiment of the medium the impression qualitycategories data are formed by sorting impression quality factors datainto the impression quality factors categories data, applying weights tothe sorted impression quality factors categories data, and accumulatingthe weighted impression quality factors categories data into theimpression quality factors categories data. In another particularembodiment of the medium the subscriber device type is selected from thegroup consisting of a personal computer, a mobile telephone, atelevision monitor, personal data assistant and web tablet. In anotherparticular embodiment, of the method the subscriber type is selectedfrom the group consisting of gender, age, income, geographic location,race and language. In another particular embodiment of the medium thesubscriber device state is selected from the group consisting of speakervolume, display on duration, display off duration and multiple deviceusage, end user device preference, and current device.

In another particular embodiment, a system is disclosed for estimatingPE for targeted advertising data in a community of users in acommunication network, the system including but not limited to aprocessor in data communication with a computer readable medium; and acomputer program embedded in the computer readable medium useful forperforming a method for estimating PE for targeted advertising data in acommunication network, the computer program comprising instructions forcorrelating impression quality factors categories data with a subscriberactivity data profile for purchases and consumption related to anadvertising category for the targeted advertising data and estimatingfrom the correlation the PE in the advertising category for the targetedadvertising data.

In another particular embodiment of the system, the computer program forestimating the PE further includes but is not limited to instructions toadd a reciprocal for a quality of impression for the advertising data toa strength of response for the advertising data, wherein the strength ofresponse indicates a degree of impact on the subscriber in anadvertising category for the advertising data. In another particularembodiment of the system, the computer program further includes but isnot limited to instructions for the estimating the strength of responseby a difference between subscriber purchases in the advertising categorybefore an impression for the advertising data and after the impressionfor the advertising data.

In another particular embodiment of the system the computer programfurther includes but is not limited to instructions to estimate thestrength of response further include but are not limited to instructionsfor dividing the difference between subscriber purchases in theadvertising category before an impression for the advertising data andafter the impression for the advertising data, by a tendency in theadvertising category, wherein the tendency is estimated as the sum ofsearches by the subscriber in the advertising category multiplied by aweighting factor M plus purchases by the subscriber in the advertisingcategory multiplied by a weighting factor N. In another particularembodiment of the system the impression quality factors categories datacomprise combinations of impression quality factors data from at leasttwo factors selected from the group consisting of subscriber devicestate data indicative of a degree of active advertising data viewing,subscriber device type data indicative of a type of subscriber devicereceiving the advertising data, content character data indicative of acontent character and subscriber type data indicative of a type ofsubscriber viewing the advertising data.

In another particular embodiment of the system the impression qualitycategories data are formed by sorting impression quality factors datainto the impression quality factors categories data, applying weights tothe sorted impression quality factors categories data, and accumulatingthe weighted impression quality factors categories data into theimpression quality factors categories data. In another particularembodiment of the system the subscriber device type is selected from thegroup consisting of a personal computer, a mobile telephone, atelevision monitor, personal data assistant and web tablet. In anotherparticular embodiment of the system the subscriber type is selected fromthe group consisting of gender, age, income, geographic location, raceand language.

In another particular embodiment of the system, the subscriber devicestate is selected from the group consisting of speaker volume, displayon duration, display off duration and multiple device usage, end userdevice preference, and current device. In another particular embodimentof the system the content character is selected from the groupconsisting of first run, rerun, special event, series episode andfinale.

In another particular embodiment a data structure embedded in a computerreadable medium is disclosed, the data structure comprising a firstfield for storing data indicative of PE for advertising data in anadvertising category based on a correlation between impression qualityfactors data and subscriber activity data. In another particularembodiment, the data structure further includes but is not limited to asecond field for storing data indicative of a quality of impression, Qwherein Q is based on the impression quality factors data. In anotherparticular embodiment of the data structure further includes but is notlimited to a third field for storing data indicative of strength ofresponse (SOR) for containing data indicative of the SOR based on adifference between present consumption and past consumption in anadvertising category for the advertising data divided by a sum ofsearches by the subscriber in the advertising category multiplied by aweighting factor M plus a consumption by the subscriber in theadvertising category multiplied by a weighting factor N.

In another particular embodiment, a computer readable medium isdisclosed containing computer program instructions that when executed bya computer perform a method for estimating PE for targeted advertisingdata in a communication network, the computer program comprisinginstructions to correlate impression quality factors categories datawith a subscriber activity data profile for purchases and consumptionrelated to an advertising category for the targeted advertising data;and instructions to estimate from the correlation the effectivity indexin the advertising category for the targeted advertising data. Inanother particular embodiment, a client device is disclosed comprising amemory containing a computer program, the computer program furthercomprising instructions to collect impression quality factors categoriesdata comprising combinations of impression quality factors data from atleast two factors selected from the group consisting of subscriberdevice state data indicative of a degree of active advertising dataviewing, subscriber device type data indicative of a type of subscriberdevice receiving the advertising data, content character data indicativeof a content character and subscriber type data indicative of a type ofsubscriber viewing the advertising data.

In another particular embodiment, a system and method distinguishbetween real-time versus time-shifted viewing: Consumers who off-shifttheir viewing by using mechanisms such as DVR and TiVo™ may be motivatedto do this partially by the opportunity it affords to fast-forward overadvertisements during replay. In addition, some pre-recorded broadcastscontaining embedded advertising data are never viewed (estimates rangeas high as one-third); or may be viewed so much later thatadvertisements have lost their value due to stale or expired offers thatare no longer relevant. Another illustrative embodiment provides fortracking viewer ship on increasingly numerous alternative viewingdevices, such as mobile MP3/video players, cell phones, and otherpersonal mobile devices, as well as traditional in-home television sets.

In another particular embodiment, a system and method estimate an“engagement” or depth of experience—how “active” is “activeviewing/listening” which is added into the impression quality factorsand thus figures into penetration data and PE. The engagement, depth ofexperience and active viewing/listening are gauged by externalindicators such as whether the sound during an advertisement on asubscriber device was tuned low, only the first few or last few secondsof a 30-second advertising spot were viewed, by which viewers inparticular, and so on.

Another illustrative embodiment provides for monitoring of advertisementviewing by demographically-differentiated audiences. Monitoring can beperformed for advertisements viewed during normal real-timebroadcasting, for both national and local channels; advertisementsviewed when replayed from any pre-recorded broadcasts; andadvertisements included as headers or trailers in video-on-demandplayouts or spliced into streaming media. Exactly which part(s) of theadvertisements were viewed for how long is available with per-second orhigher accuracy. Demographic differentiators can include but are notlimited to viewership by community location and income level brackets,as well as estimates of the number of viewers by age, educational,professional, race, and gender categories, qualified by probability.

Another embodiment correlates records which indicate when and for howlong advertisements occur in any media available for consumption bysubscribers, with records which indicate exactly what the state ofsubscribers' devices is during such designated intervals while the mediais being consumed. For example, suppose a 30-second advertisement occursone minute after the broadcast of a TV series episode starts; thesubscriber has programmed an STB or DVR to record the given episode; andthe subscriber plays back the pre-recorded show the next day. Both thepre-recording and the playback can be dependent on a communicationsystem provider, such as an Internet protocol television (IPTV) system,which through internal processing, are captured by IPTV logging.Substantially all media assets referred to herein as content availableto subscribers are inventoried with advertisements, either as providedby the supplying vendor in metadata when uploaded, or as spliced induring broadcast at national or local acquisition servers or at thereceiving subscriber device.

During playback on a subscriber device, records indicating subscriberbehavior, including whether or not and for how long audio on asubscriber device has been muted and/or fast forwarded or other controlshave been hit or initiated, are collected and stored in a subscriberacitivity data profile and impression quality factors data. Therefore,correlating the time during which the advertisement plays back withsubscriber behavior indicates whether the advertisement was rendered orpresented to the screen and/or speakers, which portions, and for howlong to per-second or greater accuracy.

Another illustrative embodiment provides subscriber activity profiledata and impression quality factors data. That is, these subscriberactivity data profile data can identify when and for how longadvertisements occur within available media, to identify subscriberbehavior about media content consumption. Another particular embodimentmonitors substantially all subscribers and substantially all subscriberdevices and generates events and records of subscriber activity andimpression quality factors data on a per-device and per-subscriberbasis. There is substantially no limitation to any specific type of DVR,STB, or even to STB devices; subtantially all consumer devices, such ascell phones or personal data assistant (PDA's) capable of consuming IPTVtriple-play or bundled services (IPTV, voice over internet protocol(VoIP) and Internet), are eligible for monitoring. In another particularembodiment, note that the mechanism introduces no distinctions betweencontent such as national or local broadcast stations, streaming video orreal-time broadcasting, or even between audio, video, and internetconsumption; in that records distinguish advertisements fromnon-advertisements by temporal indicators at sub-second granularity.

In another particular embodiment, advertising data contain digital audioor video markers that are sensed during play back on a subscriber devicethat indicate advertising playback on a subscriber device at 100%, 75%,50% and 25% duration. In particular, viewership of much more than“traditional” advertisements can be tracked using digital audio or videomarkers or temporal indicators or by correlating impression qualityfactors data with timing of advertising data presentation on asubscriber device. For example, VOD headers and trailers, or segmentswhich feature “product placement” can be identified by markers or by atime in which the product placement, header or trailer appears incontent on a subscriber device.

Internet surfing and interactive gaming are monitored, as well forsubscriber activity data and impression quality factors data to estimateadvertising data penetration. The IPTV system monitors subscriber datatransactions, electronic program guides and metadata which distinguishesadvertising data from content. With respect to internet usage, IP-levelaccess records indicate which sites were displayed to the screen and/orplayed on the speaker. Monitoring can be narrowly targeted with respectto collection intervals, audience, and types of devices, as well asrestricted to defined levels of aggregation. With respect to gaming orinteractive media consumption, vendor-specific agreements can provideappropriate metadata and/or algorithms to estimate temporal markers foradvertisements.

Another particular embodiment provides opportunities for correlation ofadvertisement viewership with patterns of consumer behavior. Forexample, tracking viewership of an advertised media event and estimatinga degree of correlation that exists between having viewed itsadvertisement(s) and tuning into, and/or pre-recording, the event.Another embodiment estimates how a degree of correlation differsdepending on whether the advertising data is presented in an episode ina “regular” series, a “special” episode in a regular series, specialevent (SUPER BOWL™, etc.) or a pay-per-view show. Another embodimentcorrelates consumers activating a new IPTV-capable device on their homenetwork with having viewed advertisement(s) for the device.

Another embodiment tracks how many and which subscriber devices are inuse referred to as (multiple device usage), including patterns for whenand how each subscriber device is utilized over time, or when and howthe subcriber devices may be used simultaneously or separately. At thislevel of granularity, estimates about how many viewers and the qualityof the viewing that occurred for specific advertisements, and thedemographics of each viewer, are derived and qualified by degree ofprobability. For example, during installation or troubleshooting,technicians may have recorded the exact placement of subscriber devicesin the home, in relation to which household members were likely to useeach subscriber device, as well as some personal characteristics ofhousehold members.

In particular, any available subscriber-specific information regardingdevice placement and IPTV VoIP and Internet consumption habits can beleveraged, as long as the final results of such calculations are limitedto aggregate quantities not trackable to specific customers. Anotherembodiment provides for demographically rich data mining ofadvertisement viewing correlated with consumer media and productconsumption behavior in a subscriber activity data profile, impressionquality factors data, penetration data and PE.

Another embodiment records and provides details of which parts ofadvertisements were rendered to the screen and/or played in audio downto per-second granularity. Due to the availability of per-subscriberrecords independently maintained in the IPTV triple play system forpurposes of billing and customer care, correlation of customer behaviorwith demographic factors are calculated, within well-defined categoriesor qualfied degrees of probability, at aggregate levels, whilemaintaining proper safeguards for privacy concerns of customers.

In another particular embodiment, subscriber impression quality factorsdata profile are calculated by correlating such subscriber relatedstatistics and the subscriber activity data profile along with othersubscriber data and information such as gender, age, income, languagesspoken, areas of interest, etc. volunteered by a subscriber during anIPTV registration process. In another particular embodiment thesubscriber activity data profile information contains data for which asubscriber has opted in for monitoring and use by an IPTV system(providing IPTV, VoIP and Internet) for the purposes of receivingtargeted advertising data. Impression quality factors data can beestimated from data included in the impression quality factors data,including but not limited to device type, subscriber type, and devicestate based on the subscriber activity data profile.

Based on subscribers' interests, background, and subscriber profiledata, one of the following targeted advertising data delivery system ormethod described herein or an equivalent thereof can be utilized toestimate PE for targeted advertising data provided to prioritizedadvertising data and television commercial delivery to end user devicesand subscriber devices including but not limited to, IPTV televisiondisplays, portable subscriber data and messaging devices such as mobileor cell phones and website banners and pop up displays on a PC orLaptop. Thus, advertisements which have the highest PE for a particularend user are presented to the end user on an end user device such as avideo presentation system during execution of trick play command data onthe end user device.

Turning now to FIG. 1, the IPTV system 100 delivers video data includingbut not limited to video data content and advertising data to subscriberhouse holds 113 and associated end user devices (also referred to hereinas subscriber devices) which may be inside or outside of the household.The video data further includes but is not limited to advertising datakeys which are embedded in the video and advertising data. Theadvertising data keys include but are not limited to text, audio,imagery and video data added to the video data and advertising data forthe video. The advertising data keys are generated from an auralrecognition and pattern recognition analysis of the video data andadvertising data. Advertisers select particular advertising data keyscategories for detection of advertising opportunities in the video data.When a particular advertising data key category is detected in a videodata stream, an advertising data key is placed in the video data or anassociated data stream.

Television advertising data advertising data keys are inserted by theadvertising server 138. In the IPTV system, IPTV channels are firstbroadcast in an internet protocol (IP) from a server at a super huboffice (SHO) 101 to a regional or local IPTV video hub office (VHO)server 103, to an intermediate office (IO) server 107 and to a centraloffice (CO) 103. The IPTV system 100 includes a hierarchically arrangednetwork of servers wherein a particular embodiment the SHO transmitsvideo and advertising data to a video hub office (VHO) 103 and the VHOtransmits to an end server location close to a subscriber, such as a COserver 103 or IO 107. In another particular embodiment, each of the SHO,VHO, CO and 10 are interconnected with an IPTV transport 139. The IPTVtransport 139 may consist of high speed fiber optic cablesinterconnected with routers for transmission of internet protocol data.The IPTV servers also provide data communication for Internet and VoIPservices to subscribers.

Actively viewed IPTV channels are sent in an Internet protocol (IP) datamulticast group to access nodes such as digital subscriber line accessmultiplexer (DSLAM) 109. A multicast for a particular IPTV channel isjoined by the set-top boxes (STBs) at IPTV subscriber homes from theDSLAM. Each SHO, VHO, CO, IO and STB includes a server 115, processor123, a memory 127, network interface 188 and a database 125. Analysis ofthe video data for advertising data key insertion is performed byprocessor 123 at the VHO. The network interface functions to send andreceive data over the IPTV transport. The CO server delivers IPTV,Internet and VoIP content to the subscriber via the IO and DSLAM. Thetelevision content is delivered via multicast and television advertisingdata via unicast or multicast depending on a target televisionadvertising group of end user client subscriber devices to which theadvertising data is directed.

In another particular embodiment, subscriber devices, also referred toherein as end user devices, are different stationary and mobile devices,including but not limited to, wire line phones 135, portable phones 133,lap top computers 118, personal computers (PC) 110 and STBs 102, 119communicate with the communication system, i.e., IPTV system throughresidential gateway (RG) 164 and high speed communication lines such asIPTV transport 139. In another particular embodiment, DPI devices 166inspect data VoIP, Internet data and IPTV video, commands and Meta data(multicast and unicast) between the subscriber devices and the IPTVsystem severs. DPI devices are used in analysis of the video data forinsertion of the advertising data keys based on advertising datacategories stored in the data base 125. In a particular embodimentadvertising data forwarding and discussion of advertising data anduser-to-user connectivity are detected by the DPI devices that monitorat data sent between end users. End user source and destinationidentifier data in data sent between end users are used to trackuser-to-user connectivity. Image, text and sound recognition functionsare used to detect advertising data discussion and forwarding inaddition to the DPI devices. Textual and aural key words and imageryfound in the advertising data and messages sent and received by end userdevices are inspected by the DPI devices 166 and image recognitionfunctions in the processors 123 in the communication system servers andend user devices are used as indicators found in messages sent betweenusers to estimate penetration of advertising data from discussion andforwarding of the advertising data between users, also referred toherein as end user devices. Impression quality factions for end usersidentified in penetration data are used to estimate PE.

In another illustrative embodiment impression quality factors data aremonitored and collected whether or not the subscriber's devices are inthe household 113 or mobile outside of the household such as cellularphones 134. When outside of the household, subscriber mobile device datais monitored by communication network (e.g. IPTV) servers and DPIdevices which associate the impression quality factors data withparticular subscribers. In another particular embodiment, impressionquality factors data including subscriber activity data such ascommunication transactions are inspected by DPI devices located in acommunication system, e.g., IPTV system servers. These communicationsystem servers route the impression quality factors data to a VHO or COin which the impression quality factors data for a subscriber are storedfor processing.

In another particular embodiment, the end user devices or subscriberdevices include but are not limited to a client user computer, apersonal computer (PC) 110, a tablet PC, a set-top box (STB) 102, aPersonal Digital Assistant (PDA), a cellular telephone 134, a mobiledevice 134, a palmtop computer 134, a laptop computer 110, a desktopcomputer, a communications device, a wireless telephone, a land-linetelephone, a control system, a camera, a scanner, a facsimile machine, aprinter, a pager, a personal trusted device, a web appliance, a networkrouter, switch or bridge, or any machine capable of executing a set ofinstructions (sequential or otherwise) that specify actions to be takenby that machine. In another particular embodiment, a deep packetinspection (DPI) device 124 inspects multicast and unicast data,including but not limited to VoIP data, Internet data and IPTV video,commands and Meta data between the subscriber devices and betweensubscriber devices and the IPTV system severs.

In another illustrative embodiment impression quality factors data aremonitored and collected whether or not the subscriber devices are in thehousehold 113 or the devices are mobile devices 134 outside of thehousehold. When outside of the household, subscriber mobile device datais monitored by communication system (e.g., IPTV) servers whichassociate the impression quality factors data with each particularsubscriber's device. In another particular embodiment, impressionquality factors data including subscriber activity data such ascommunication transactions are inspected by DPI devices located in acommunication system, e.g., IPTV system servers. These communicationsystem servers route the impression quality factors data to a VHO inwhich the impression quality factors data for a subscriber are storedfor processing in determining advertising data penetration andprioritization of the advertising data for end users and for highlyconnected users (HCUs) based on end users and HCUs contributions to thepenetration of the advertising data.

As shown in FIG. 1 advertising sub groups 112 (comprising a group ofsubscriber house holds 113) receive multicast advertising data andadvertising data keys in video data stream from 10 server 107 via CO 103and DSLAM 109 at STB 102. In another particular embodiment, each STB isconfigured to perform DVR functionality using memory, processor and database on board the STB. Individual households 113 receive advertisingdata at set top box 102 or one of the other subscriber devices. Morethan one STB (see STBI 102 and STB2 119) can be located in an individualhousehold 113 and each individual STB can receive a separate multicastor unicast advertising stream on IPTV transport 139 through DSLAM 109.In another particular illustrative embodiment separate and uniqueadvertising data are displayed at each set top box (STB) 102, 119tailored to target the particular subscriber watching television at thatparticular STB. Each STB 102,119 has an associated remote control (RC)116 and video display 117. The subscriber via the RC selects channelsfor a video data viewing selection (video programs, games, movies, videoon demand), initiates trick play commands data to the STB/DVR and placesorders for products and services over the IPTV system 100. Advertisingdata keys are generated and inserted at the VHO and used to selectadvertising data that is then sent to end user devices. In anotherembodiment, advertising data keys are generated at the end user devicesby processors at the end user devices. Advertising data at the end userdevices can then be selected for display by the end user devices basedon processing of the advertising data keys described herein.

FIG. 1 depicts an illustrative communication system, including but notlimited to a television advertising insertion system wherein televisionadvertising data can be inserted at an IPTV (SHO, VHO, CO) server or atthe end user client subscriber device, for example, an STB, mobilephone, web browser or personal computer. Advertising data can beinserted into an IPTV video stream via advertising insertion device 129at the IPTV VHO server 105 or at one of the STBs 102, 109. The IPTVservers include an advertising server 138 and an advertising database139. The advertising data is selected by advertising selection element129 from the advertising database 125 based on subscriber profile dataand delivered by the VHO advertising server 138 to the IPTV VHO server115. An SHO 101 distributes video, advertising and subscriber profiledata to a regional VHO 103 which distributes data to local COs 105 whichdistribute data via IO 107 to a digital subscriber access lineaggregator multiplexer (DSLAM) access node to subscriber devices such asSTBs 102, 119, PC 110 wire line phone 135, mobile phone 133 etc.Advertising data is also selected based on the community profile forusers in the community and sent to a mobile phone or computer associatedwith the subscriber or end user devices in the community. The communitysubscriber profile is built based on a community of subscriber's IPTV,Internet and VoIP activity. Compensation system 121 determinescompensation for HCUs based on advertising data penetration.

Turning now to FIG. 2, FIG. 2 depicts a flow chart for functionsperformed in another illustrative embodiment for delivering advertisingdata to subscribers in a communication system, such as an IPTV system.As shown in FIG. 2 in block 202 an illustrative embodiment receivesdata, for example, advertising data containing advertising data keysassociated with video data. In block 204 a particular illustrativeembodiment correlates the advertising data keys with advertising types,penetration data, PE and penetration categories. Advertising dataassociated with the advertising data keys are prioritized based on thecorrelation of the advertising data keys with advertising types,penetration data, PE and penetration categories. In block 206, aparticular illustrative embodiment selects the highest advertising datato present to the end user during execution of trick play command databased on the correlation. In block 208 a particular illustrativeembodiment presents the selected prioritized advertising data to the enduser during execution of the trick play command data.

Turning now to FIG. 3, in an illustrative embodiment a community of endusers 302 includes a number of subscribers or end users associated withsubscriber/end user devices 304, 306, 308, 310, 312, 314, 316 and 318.User-to-user connectivity is measured by number, frequency, duration ofand data volume of interactions 303 between end user devices associatedwith end users or subscribers 304, 306, 308, 310, 312, 314, 316, and318. As shown in FIG. 3, end users 310, 312, 314, 316, and 318 havesubstantially more user-to-user connectivity than end users 304, 306 and308. In a particular embodiment, end users 310, 312, 314, 316, and 318are classified as highly connected users (HCUs). Each HCU has a zone ofinfluence (ZOI) defined by connectivity between the HCU and end usersoutside of the community 302. The ZOI for HCU 312 includes end users316, 318 and 320. HCU to ZOI connectivity is measured by the number,frequency, duration and data volume of interactions 305 between the HCUand the end users 316, 318 and 320 in the ZOI. HCU 312 connectivityoutside of the ZOI is measured by the number, frequency, duration anddata volume of interactions 307 between the HCU 312 ZOI end users 316,318 and 320 and end users 328, 330, 332 and 334. Interactions 303, 305and 307 are monitored to determine advertising data forwarding,advertising data discussion and advertising data penetration within theZOI and beyond the ZOI.

Turning now to FIG. 4, in a particular embodiment, a flow chart 400 offunctions are preformed. The order of execution of functions and theselected functions to be executed is different in different embodimentsand is not limited to the order of execution and functions shown in FIG.4. As shown in FIG. 4, in block 402 an illustrative embodiment measuresuser-to-user connectivity between end users within the community ofusers in a communication system. In block 404 an illustrative embodimentdetermines HCUs as users who are most connected to others end users inthe community. In block 406 an illustrative embodiment determines a ZOIfor each HCU. In block 408 an illustrative embodiment characterizes eachHCU ZOI by type of affiliation (i.e., type of data exchange anddiscussion type, i.e. sports, news, fashion, etc.) between end users inthe HCU ZOI. In block 410 an illustrative embodiment assigns weights toeach HCU according to the HCU ZOI characterization for the HCU. The HCUZOI characterization includes but is not limited to type of affiliation,frequency and duration of connections to ZOI and beyond the ZOI.

In block 412, an illustrative embodiment determines a device type for anHCU and end users in the community and ZOI used to connect to each otherfor advertising data forwarding and advertising data discussion. Inblock 414 an illustrative embodiment a VHO sends advertising data to anuppermost top tier HCU in the community based on ZOI characterization.In block 416, an illustrative embodiment measures interactions includingbut not limited to advertising data forwarding and advertising datadiscussion in each HCU in the community of end users and between the HCUand the end users in the HCU ZOI. In block 418 an illustrativeembodiment measures or determines penetration of advertising data fromeach HCU and the community in which the HCUs reside based on forwardingof advertising data and discussion of advertising data from the HCU tothe community and to the end users in the ZOI. In block 420 anillustrative embodiment determines PE for the penetration data. In aparticular embodiment the community is a group of end users associatedby similar demographic, geographic or interests.

Turning now to FIG. 5, in a particular illustrative embodiment a datastructure embedded in a computer readable medium is disclosed. The datastructure includes but is not limited to a first field 502 forcontaining priority ranking data indicative of prioritization data forpresentation of prioritized advertising data to an end user. In anotherparticular embodiment, the data structure further includes a secondfield 504 for containing data indicative of HCUs in the community of endusers. In a particular embodiment, the data structure further includes athird field 506 for containing data indicative of a ZOI of end users inan HCU ZOI for each HCU identified in field 504. In another particularembodiment, the data structure further includes a fourth field 508 forcontaining data indicative of ZOI characterization for each HCU ZOI. Ina particular embodiment, the data structure further includes a fifthfield 510 for containing data indicative of HCU weights for each HCU.

In a particular embodiment, the data structure further includes a sixthfield 512 for containing data indicative of containing correlation dataindicating a correlation between advertising characterization data andthe HCU weights. In a particular embodiment, the data structure furtherincludes a seventh field 514 for containing data indicative of advertingdata sent to the HCUs and monitored for forwarding, discussion,penetration and PE.

In a particular embodiment, the data structure further includes aneighth field 516 for containing data indicative of advertising dataforwarding from the HCU and from the ZOI. In a particular embodiment,the data structure further includes a ninth field 518 for containingdata indicative of advertising discussion between the HCU and members ofthe community and between the community and the HCU ZOI which startedfrom the HCU. In a particular embodiment, sender identifiers in the datatransmissions are used to identify, in an IPTV server or DPI device, thesource of a forwarded advertising data and discussion message. In aparticular embodiment, the data structure further includes a tenth field520 for containing data indicative of advertising penetration data forthe identified advertising data 514. In a particular embodiment, thedata structure further includes an eleventh field 522 for containingdata indicative of advertising penetration effectivity data. In aparticular embodiment, the data structure further includes a twelfthfield 524 for containing data indicative of advertising key data. In aparticular embodiment, the data structure further includes a twelfthfield 526 for containing data indicative of advertising category data.In a particular embodiment, the data structure further includes athirteenth field 528 for containing data indicative of advertisingpenetration category data. In another particular embodiment, the datastructure further includes a fourteenth field 530 for containing dataindicative of trick play command data to be executed on an end userdevice during presentation of the prioritized advertising data.

FIG. 6 depicts a data flow diagram for another illustrative embodimentof a system for sending advertising data and monitoring data sent andreceived by various subscriber devices associated with subscribers in anIPTV system 100 for monitoring advertising impression quality factorsdata, advertising data forwarding and advertising data discussion forthe subscriber devices. In a particular, illustrative embodiment, theimpression quality factors data 602 are accumulated at a subscriberdevice or through database entries available in the IPTV networksubscriber devices report their impression quality factors data to theIPTV system. As shown in FIG. 6 the device state 610, device type 616and subscriber type 612 are accumulated as impression quality factorsdata 602. These impression factors quality data, including but notlimited to advertising data discussion and advertising data forwarding,are categorized into impression quality factors data categories, andweighted at 604 using weights assigned by the IPTV system for particularimpression factor quality data categories. The weighted HCUs, impressionquality factors and categories data are correlated with the subscriberactivity data 614. The correlation of the weighted, impression qualityfactors categories data and the subscriber activity data are utilized toestimate the penetration data and penetration effectivity data 608 forend users for the advertising data.

Turning now to FIG. 7, in an illustrative embodiment a function 700 isperformed to correlate the impression quality factors category data withthe subscriber activity data. The subscriber activity data includes datafrom a subscriber activity data profile which chronicles purchases andmedia consumption for a subscriber. Purchases can include but are notlimited to purchases over the Internet via eCommerce as well aspurchases of media content such as music, movies, books and video ondemand. Media consumption can include but is not limited to programswatched, web sites visited, games played, searches performed and musicdownloaded. Subscriber activity data is collected at the subscriberdevice and at the IPTV system though monitoring data sent and receivedto and from the subscriber devices. Subscriber activity data includesbut is not limited to data indicating advertising data forwarding,discussion and user-to-user connectivity for a subscriber. As shown atblock 702, a particular embodiment estimates the quality of advertisingimpression, Q using the impression quality factors categories data. Theimpression quality factors data are sorted into categories and weightedas discussed below.

At block 704 a particular embodiment estimates the strength of response(SOR). The SOR is a measure of the impact or degree of influence that aparticular advertising data has on a subscriber in a particularadvertising category, based on changes in the subscriber's purchasingand/or consumption after receiving the advertising data directly,forwarded from another user or discussed with another user. The rate ofchange over time for an SOR in a particular advertising category is atrend for the particular advertising category. The advertising categorymay be associated with or the same as one of the impression qualityfactors categories. The subscriber's purchasing and/or consumption trendis estimated from changes in the subscriber's subscriber activity dataprofile in a particular advertising category. The subscriber activitydata profile captures purchases and/or consumption by a subscriber bytracking transactions and selections made on the IPTV triple playnetwork and sorting the transactions into advertising, product andinterest categories. These purchases and consumption may include but arenot limited to IPTV, VoIP and Internet purchases and consumption. Inanother embodiment, the SOR equals a quantity for present purchasesand/or consumption in a particular advertising category associated withthe advertising data, minus a quantity for past purchases and/orconsumption in a particular advertising category associated with theadvertising data; divided by an indication of the subscribers interestin the advertising category as indicated by a number of searches in theparticular advertising data category times a weighting factor, M pluspurchases and/or consumption in the particular advertising data categorymultiplied by waiting factor, N.

The weighting factors M and N are programmable so that searches in aparticular advertising category can be weighted more or less thanpurchases and/or consumption in a particular advertising category.Advertising categories can include but are not limited to sports,fashion, art, literature, action movies, mysteries, food, travel andhealth. At block 706 a particular embodiment estimates the effectivityindex, (El) as equal to one divided by the estimate of the quality ofadvertising impression, Q added to the strength of response (SOR). Inanother particular illustrated embodiment, a subscriber household 113sends impression quality factors data from an RG or STB in a subscriberhousehold or from a mobile device to an access node such as a DSLAM 109.When sent to the VHO, the identity of the subscriber is associated withthe impression quality factors data. The identity of the subscriber canbe stripped off of the data as it is aggregated in the IPTV system. Theaccess node 109 sends data to a VHO through a CO.

In another particular illustrative embodiment service applications areprovided by a communication network such as an IPTV system. The serviceapplications include but are not limited to an IPTV system providingIPTV, Internet and VoIP (herein referred to as an IPTV system).Advertisements are inserted by the IPTV system into SMS messages, videoand HTML data the IPTV system by advertising server 138. The service VHOcommunicates with the subscriber household 113 via the IPTV systemservers and collects the subscriber data comprising the impressionquality factors data from the household, the access node, aggregationnetwork, service network and service applications.

In another particular illustrative embodiment access node controlprotocol (ANCP) is used to communicate between the service CO or IO inthe communication network and an access node 109. In another particularillustrative embodiment access node 109 is a DSLAM. In anotherillustrative embodiment, the aggregation network or central office 109communicates with the SHO and VHO. In another particular illustrativeembodiment, the CO communicates with the service application or IPTVsystem over an IPTV system communication path.

In another particular illustrative embodiment, the VHO receivesimpression quality factors data, including but not limited to devicestate data indicative of a degree of active advertising data viewing,device type data indicative of a type of advertising device, receivingthe advertising data, and subscriber type data indicative of a type ofsubscriber viewing the advertising data. The impression quality factorsdata further include but are not limited to channel viewer ship dataincluding but not limited to multicast join data indicating what IPTVprogram a subscriber is watching, subscriber device state data andsubscriber activity data collected from the access node. The VHOreceives the impression quality factors data, advertising dataforwarding data, advertising data discussion data, penetration data andsends the data to the data base 125. The data base 125 collectsimpression quality factors data, including but not limited toadvertising data forwarding and advertising data discussion, appliesweights and curves 130, correlates the weighted and accumulatedimpression quality factors categories data 128 with advertising qualitycriteria data to generate the qualified impression quality count 136.HCUs are rated based on their contribution to penetration of theadvertising data.

As shown in FIG. 1, in a particular embodiment, impression qualityfactors data and impression quality factors categories data 128,impression quality factor categories weights, subscriber activity dataprofiles and curves 130 and penetration data 129 are stored at the VHOdata base. The impression quality factors categories data and subscriberactivity data are correlated 132 at the CO level and above. A number ofcustomers viewing the commercial or advertising data vary at each timein a time interval.

Turning now to FIG. 8 a flowchart 800 is illustrated for anotherparticular embodiment in which functions are performed. As shown inblock 802 in another particular illustrative embodiment a functionstarts and proceeds to block 804, where a server receives impressionquality factors data from subscriber devices comprising subscriberdevice state, device type, subscriber type, multiple device usage,current device state, and application curve. In another particularillustrative embodiment at block 806, the impression quality factorsdata are sorted into impression quality factors categories data andweights are applied to the impression quality factors category data toestimate qualified impression quality, Q. At block 808, anotherembodiment accumulates weighted impression quality factors, andgenerates a histogram of the accumulated impression quality factorcategories data. The impression quality factors are applied to thetransactions between end users including but not limited to advertisingdata discussion and advertising data forwarding.

In another particular illustrative embodiment, an advertiser assignsweights from one through ten (1-10) to impression quality factor datacategories. Thus when advertising data is discussed or forwarded to auser, impression quality factors data are calculated for the recipientof the advertising data forwarded or discussion data pertaining to theadvertising data. The impression quality factor data categories includebut are not limited to impressions for particular subscriber devicetypes for particular subscriber types in particular advertisingcategories. Advertising categories are assigned by the IPTV system. Theadvertising categories in another particular embodiment include but arenot limited to luxury cars, travel, health, education and entertainment.

For example, impressions are qualified for a forwarded or discussedadvertising data for a particular advertising category, luxury cars fora particular subscriber type, women. In this example, a particularluxury car slanted toward women are assigned weights as follows: Foradvertisements forwarded or discussed and viewed on television, a weightof 10 is assigned for women age 35-55, a weight of 7 for women age18-35, a weight of 8 for men 35-55, a weight of 5 for men 18-35. Foradvertisements viewed on mobile telephones, a weight of 8 for women age35-55, a weight of 5 for women age 18-35, a weight of 6 for men age35-55, a weight of 4 for men age 18-35. For online commercials forwardedor discussed and viewed a weight of 6 for women age 35-55, a weight of 3for women age 18-35, a weight of 4 for men age 35-55, a weight of 2 formen age 18-35.

Geographic weights are also assigned by advertisers based on desiredgeographic coverage for a ZOI and penetration desired for particularadvertising data. A histogram of viewers sorted by impression qualityfactor categories is generated showing how many viewers in eachimpression quality factor category viewed a particular advertisement.Different weights are assigned for advertising data forwarded andadvertising data discussed, depending on the advertiser's set parametersfor calculating advertising data penetration. In a particularembodiment, a weight of 5 out of 10 is assigned for forwardingadvertising data, a weight of 7 assigned for replaying the forwardedadvertising data and a weight of 3 assigned for discussing theadvertising data.

An additional weight point can be assigned (i.e., given a weight of 9instead of 8) to subscribers who receive and view forwarded advertisingdata on a subscriber device that is received and viewed on theirpreferred subscriber device as indicated by a subscriber devicepreference. A subscriber device preference is indicated by a subscriberprofile showing that prior reception of advertisements on a particularsubscriber device type are viewed and not skipped. For example, if asubscriber receives an advertisement on a television for a particularproduct but only views 10 seconds of a 30 second advertisement, butviews the entire advertisement of the same advertisement on a mobilephone, then the subscriber's preferred subscriber device is a mobilephone and advertisements viewed on the mobile phone are given extraweight. In this case the subscriber device preference is the mobilephone. In another particular embodiment, a subscriber device preferenceis indicated by a subscriber selection at registration with acommunication network.

Values can also be assigned for duration or how much of an advertisementa particular subscriber watched. If a subscriber only saw the first 10seconds of a 30 second advertisement, the advertisement viewing receivesa only one sixth of its assigned weight and may be deemed asinappropriate for the demographic and device type for that particularviewer type, for example, males 18-35 on a mobile phone. If the sameadvertisement is watched for the last 20 seconds of the advertisement,the advertisement viewing receives three fourths of its assigned weightand deemed appropriate for the demographic and device type for thatparticular viewer type, for example, males 18-35 on a mobile phone. Theweighted impression quality factors are adjusted for duration andaccumulated for additional processing.

At block 810 a particular illustrative embodiment applies curves to atleast two of the accumulated compression quality factor categories datato generate curve-adjusted impression quality factors categories data.In a particular embodiment, different curves are applied to differentimpression quality factor categories data to generate curve-adjustedimpression quality factor categories data. For example, continuing withthe luxury car example from above, different curves are applied todifferent accumulated impression quality factors categories data. An Scurve in applied data for men ages 18-35 and 35-55, a linear curve todata for women age 35-55 and an exponential curve to data for women age35-55. In another particular illustrative embodiment, at block 812 aparticular illustrative embodiment correlates the curve-adjustedimpression quality factor categories data with a set of advertisingadvertiser quality criteria data to refine the estimate of the qualifiedimpression, Q The advertiser quality criteria data may favor or weightparticular groups in particular advertising categories at particulartimes and contexts.

The curve adjusted impression quality factors categories generated inblock 810, are compared to advertiser quality criteria data as follows.An advertiser provides impression quality criteria data for ratingimpression quality, Q by device type and subscriber type. In aparticular illustrative embodiment, impression quality criteria datagive a value of 10 points each to every television impression viewed bya woman age 35-55 with an income over $100,000, 9 points for man age35-55 with an income over $100,000 and 8 points for woman age 35-55 withan income $50,000-$99,000. At block 814 a particular embodimentestimates a PE based on the IQF for penetration data. In a particularillustrative embodiment, the flow of function execution ends at block816.

Turning now to FIG. 9, in an illustrative embodiment, a flowchart 900 offunctions is performed as illustrated in FIG. 9. The execution offunctions illustrated in any flow chart illustrated in this disclosureis not dictated by the order of the flow chart, including but notlimited to the flow charts of FIG. 9 and FIG. 10, as the functions shownin any flow chart can be executed in any order as well as one or morefunctions can be left out of execution altogether in other particularembodiments. In a particular illustrative embodiment, the functionexecution starts at terminal 902 and proceeds to block 904, where aparticular illustrative embodiment detects advertising data items in thevideo data stream. The advertising data items are detected at the COlevel in the CO server and advertising data characterization performedin a particular illustrative embodiment at the CO level server. Inanother embodiment, the advertising data items are detected at the enduser device level in the end user device processor and advertising datacharacterization performed in a particular illustrative embodiment atthe end user processor. The detected advertising data items are storedin a buffer at the end-user device. An illustrative embodiment detects astart of a trick play command data for the presentation of video data.An illustrative embodiment, calculates the duration of the trick playcommand as well as the duration of the advertising data items detectedand stored in the buffer. An illustrative embodiment then proceeds toblock 906 and presents a highest prioritized advertising data item onthe main display screen during trick play command execution. Anillustrative embodiment then proceeds to block 908 and detects the endof the trick play command execution duration. An illustrative embodimentthen proceeds to block 910 and presents the remainder of the highestpriority advertising data item on a picture-in-picture (PIP) displaywithin the main display screen. An illustrative embodiment ends atterminal 912.

Turning now to FIG. 10, in another particular illustrative embodiment, aflowchart of functions is performed as shown in flowchart 1000.Flowchart 1000 indicates that another particular embodiment beginsexecution of functions at terminal 1002 and proceeds to block 1004 anddetects advertising data in the video data stream, performs advertisingdata prioritization and characterization and stores the advertising dataas advertising data items in a buffer at the end-user device. Anillustrative embodiment then calculates the trick play executionduration and the advertising data duration for the advertising dataitems detected in the video data stream. In another illustrativeembodiment, the advertising data items are detected upstream in the IPTVsystem and the duration of trick play and advertising prioritization andcharacterization data for the advertising data items calculated upstreamand sent to the end user device in a data stream. In anotherillustrative embodiment, the advertising data items are detected at theend user device in the IPTV system and the duration of trick play andadvertising characterization data for the advertising data itemscalculated at the end user device.

An illustrative embodiment then proceeds to block 1006 and presents thefirst priority (highest priority) or primary advertising data item onthe main display screen during the duration of the trick play execution.An illustrative embodiment then proceeds to block 1008 where it presentsthe secondary advertising data items in a PIP displays on the maindisplay screen. An illustrative embodiment then proceeds to block 1010and displays each secondary priority advertising data item from each PIPdisplay in succession on the main display for a prorated portion of theduration of trick play execution command. The prorated duration can be aprorated portion of the trick-play command execution duration or aprorated portion of extended trick-play command execution duration. Theprorated duration for each successive priority advertising data item iscalculated based on one or more of the following factors: normal displayduration for each advertising data item selected for display versus thetotal normal display duration of all advertising data items selected fordisplay; comparative degree of correlation for each advertising dataitem between the end user profile and the advertising characterizationdata; and comparative costs paid by an advertiser for presentation ofparticular advertising data items.

Turning now to FIG. 11, in another illustrative embodiment 1100, thehighest priority advertising data 1104 are presented on main display1102 during trick play execution. After the expiration of the trick playexecution duration, that is the end of the trick-play execution, whichin some embodiments is extended beyond the trick-play executionduration, the highest priority advertising data remaining to bedisplayed is then presented in a PIP display 1106. A particularillustrative embodiment uses the advertising data queue to determinewhich advertising data item is present in the main display and the PIPdisplay.

Turning now to FIG. 12, in another illustrative embodiment, a highestpriority advertising data item is presented first in the main display1202 and secondary priority advertising data items are presentedalternatively in PIP windows 1206, 1208 and 1210. The secondary priorityadvertising data items are presented one at a time on the main display.In a particular embodiment selection of highest priority advertisingdata items and secondary priority advertising data items are dictated bythe advertising data queue. In another embodiment, the highest priorityand secondary priority advertising data items are received from the IPTVsystem via a data stream to the end user device (multicast or unicast)and mapped to the main display or PIP displays by the end user devicebased on the advertising data queue.

Turning now to FIG. 13, an illustrative embodiment of a data structure1300 embedded in computer readable memory is disclosed. As shown in FIG.13, the data structure includes a field 1302 for containing dataindicative of advertising data items. The advertising data items areassociated with advertising characterization data stored in the database. The advertising data items are detected in the incoming video datastream and stored in a buffer in memory. In an illustrative embodiment,the data structure further includes a field 1304 for containing dataindicative of the advertising display data item currently displayed onmain display. In another illustrative embodiment the data structurefurther includes a field 1306 for containing data indicative of aprimary PIP advertising data item. The primary PIP advertising data itemindicates the advertising data item that is presently presented in thefirst PIP display space 1202 on the main screen. The data structurefurther includes a field 1308 for containing data indicative ofsecondary PIP advertising data items 1-N, in PIP windows 1204, 1206where the total number of advertising data items (primary data itemsplus second data items) equals N+1. The field 1308 indicates advertisingdata items displayed within the PIP displays 1 through N. The PIPdisplays of secondary advertising data items are rotated through themain screen advertising display space as described herein.

The primary advertising data item on the main display is replaced on themain display by each of the secondary advertising data items from thePIP displays one at a time. The primary data item is chosen based on aprice paid to display the advertising data item and a correlation indexfrom a correlation between the advertising characterization data for theadvertising data item and end user profile data. In another illustrativeembodiment, the data structure further includes a field 1310 forcontaining data indicative of the total duration of the primary andsecondary advertising data items. In another illustrative embodiment,the data structure further includes a field 1312 for containing dataindicative of the trick play duration total time. In anotherillustrative embodiment the data structure further includes a field 1314for containing data indicative of the duration for each primary andsecondary advertising data item. In another illustrative embodiment thedata structure further includes a field 1316 for containing dataindicative of the advertising characterization data for the advertisingdata items.

In another illustrative embodiment the data structure further includes afield 1318 for containing data indicative of the end user profile data.The end user profile data is correlated with the advertisingcharacterization data to generate a degree of correlation or acorrelative index for each primary and secondary advertising data item.In another illustrative embodiment the data structure further includes afield 1320 for containing data indicative of an advertising data queue.The advertising data queue identifies primary and secondary advertisingdata items for display on the main display screen and each of the PIPscreens. In another illustrative embodiment the data structure furtherincludes a field 1322 for containing data indicative of primary andsecondary data stream addresses. The primary and secondary advertisingdata stream addresses are delivered from the IPTV system in multicastand/or unicast and joined by the end user device to receive advertisingdata for display of each of the PIP displays and the main display.

In a particular illustrative embodiment, the advertising data streamsare mapped to the main display and PIP displays according to theadvertising data queue which dynamically identifies primary andsecondary data items for display on the main display screen and each ofthe PIP display screens. In a particular embodiment, end users receivethe same advertising data stream containing the same primary andsecondary data items but receive different advertising data queue datavia unicast or a separate multicast address. In a particular embodiment,end users receive a different advertising data stream containingdifferent primary and secondary data items and receive differentadvertising data queue data via unicast or a separate multicast address.In another illustrative embodiment the data structure further includes afield 1324 for containing data indicative of primary and secondary datapresentation duration. The presentation duration dynamically indicateshow long a particular primary or secondary advertising data item ispresented in a particular main display or PIP window display.

The advertising data queue, primary and secondary data stream addressesand primary and secondary data presentation duration are updateddynamically. These dynamic updates are based on several factors,including but not limited to, IPTV system data transmission bandwidthavailable between the IPTV system and the end user device, changingadvertising goals for advertisers who in turn provide differentadvertising data types of advertising data items thereby causing anembodiment to generate different advertising data to correlate with anend user profile for selecting an advertising data item to be presentedand changes in end user profile data.

In another embodiment a system and method are provided that detect thepresence of a trick play command, a PIP data stream containing primaryand secondary advertising data items and a main data stream containingvideo data items for display at an end user device. In this particularembodiment, data indicating a queue of advertising data items istransmitted over the PIP data stream. The queue contains data thatidentifies primary and secondary advertising data items for display inPIP and main display areas of an end user device display. Theadvertising data may be the same or different for different individualusers. In a particular embodiment, the advertising data is sent viamulticast to a group of end user devices. In a particular embodiment,the advertising data is sent via unicast to each of a group of end userdevices. In another embodiment, an advertising data queue is sent toeach end user device to direct presentation in PIP and main screendisplay of primary and secondary data items in the advertising datadelivered by multicast.

FIG. 14 is a diagrammatic representation of a machine in the form of acomputer system 1400 within which a set of instructions, when executed,may cause the machine to perform any one or more of the methodologiesdiscussed herein. In some embodiments, the machine operates as astandalone device. In some embodiments, the machine may be connected(e.g., using a network) to other machines. In a networked deployment,the machine may operate in the capacity of a server or a client usermachine in server-client user network environment, or as a peer machinein a peer-to-peer (or distributed) network environment. The machine maycomprise a server computer, a client user computer, a personal computer(PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant(PDA), a cellular telephone, a mobile device, a palmtop computer, alaptop computer, a desktop computer, a communications device, a wirelesstelephone, a land-line telephone, a control system, a camera, a scanner,a facsimile machine, a printer, a pager, a personal trusted device, aweb appliance, a network router, switch or bridge, or any machinecapable of executing a set of instructions (sequential or otherwise)that specify actions to be taken by that machine.

It will be understood that a device of the present invention includesbroadly any electronic device that provides voice, video or datacommunication. Further, while a single machine is illustrated, the term“machine” shall also be taken to include any collection of machines thatindividually or jointly execute a set (or multiple sets) of instructionsto perform any one or more of the methodologies discussed herein.

The computer system 1400 may include a processor 1402 (e.g., a centralprocessing unit (CPU), a graphics processing unit (GPU), or both), amain memory 1404 and a static memory 1406, which communicate with eachother via a bus 1408. The computer system 1400 may further include avideo display unit 1410 (e.g., liquid crystals display (LCD), a flatpanel, a solid state display, or a cathode ray tube (CRT)). The computersystem 1400 may include an input device 1412 (e.g., a keyboard), acursor control device 1414 (e.g., a mouse), a disk drive unit 1416, asignal generation device 1418 (e.g., a speaker or remote control) and anetwork interface.

The disk drive unit 1416 may include a machine-readable medium 1422 onwhich is stored one or more sets of instructions (e.g., software 1424)embodying any one or more of the methodologies or functions describedherein, including those methods illustrated in herein above. Theinstructions 1424 may also reside, completely or at least partially,within the main memory 1404, the static memory 1406, and/or within theprocessor 1402 during execution thereof by the computer system 1400. Themain memory 1404 and the processor 1402 also may constitutemachine-readable media. Dedicated hardware implementations including,but not limited to, application specific integrated circuits,programmable logic arrays and other hardware devices can likewise beconstructed to implement the methods described herein. Applications thatmay include the apparatus and systems of various embodiments broadlyinclude a variety of electronic and computer systems. Some embodimentsimplement functions in two or more specific interconnected hardwaremodules or devices with related control and data signals communicatedbetween and through the modules, or as portions of anapplication-specific integrated circuit. Thus, the example system isapplicable to software, firmware, and hardware implementations.

In accordance with various embodiments of the present invention, themethods described herein are intended for operation as software programsrunning on a computer processor. Furthermore, software implementationscan include, but not limited to, distributed processing orcomponent/object distributed processing, parallel processing, or virtualmachine processing can also be constructed to implement the methodsdescribed herein.

The present invention contemplates a machine readable medium containinginstructions 1424, or that which receives and executes instructions 1424from a propagated signal so that a device connected to a networkenvironment 1426 can send or receive voice, video or data, and tocommunicate over the network 1426 using the instructions 1424. Theinstructions 1424 may further be transmitted or received over a network1426 via the network interface device 1420. The machine readable mediummay also contain a data structure for containing data useful inproviding a functional relationship between the data and a machine orcomputer in an illustrative embodiment of the disclosed system andmethod.

While the machine-readable medium 1422 is shown in an example embodimentto be a single medium, the term “machine-readable medium” should betaken to include a single medium or multiple media (e.g., a centralizedor distributed database, and/or associated caches and servers) thatstore the one or more sets of instructions. The term “machine-readablemedium” shall also be taken to include any medium that is capable ofstoring, encoding or carrying a set of instructions for execution by themachine and that cause the machine to perform any one or more of themethodologies of the present invention. The term “machine-readablemedium” shall accordingly be taken to include, but not be limited to:solid-state memories such as a memory card or other package that housesone or more read-only (non-volatile) memories, random access memories,or other re-writable (volatile) memories; magneto-optical or opticalmedium such as a disk or tape; and carrier wave signals such as a signalembodying computer instructions in a transmission medium; and/or adigital file attachment to e-mail or other self-contained informationarchive or set of archives is considered a distribution mediumequivalent to a tangible storage medium. Accordingly, the invention isconsidered to include any one or more of a machine-readable medium or adistribution medium, as listed herein and including art-recognizedequivalents and successor media, in which the software implementationsherein are stored.

Although the present specification describes components and functionsimplemented in the embodiments with reference to particular standardsand protocols, the invention is not limited to such standards andprotocols. Each of the standards for Internet and other packet switchednetwork transmission (e.g., TCP/IP, UDP/IP, HTML, and HTTP) representexamples of the state of the art. Such standards are periodicallysuperseded by faster or more efficient equivalents having essentiallythe same functions. Accordingly, replacement standards and protocolshaving the same functions are considered equivalents.

The illustrations of embodiments described herein are intended toprovide a general understanding of the structure of various embodiments,and they are not intended to serve as a complete description of all theelements and features of apparatus and systems that might make use ofthe structures described herein. Many other embodiments will be apparentto those of skill in the art upon reviewing the above description. Otherembodiments may be utilized and derived there from, such that structuraland logical substitutions and changes may be made without departing fromthe scope of this disclosure. Figures are also merely representationaland may not be drawn to scale. Certain proportions thereof may beexaggerated, while others may be minimized. Accordingly, thespecification and drawings are to be regarded in an illustrative ratherthan a restrictive sense.

Such embodiments of the inventive subject matter may be referred toherein, individually and/or collectively, by the term “invention” merelyfor convenience and without intending to voluntarily limit the scope ofthis application to any single invention or inventive concept if morethan one is in fact disclosed. Thus, although specific embodiments havebeen illustrated and described herein, it should be appreciated that anyarrangement calculated to achieve the same purpose may be substitutedfor the specific embodiments shown. This disclosure is intended to coverany and all adaptations or variations of various embodiments.Combinations of the above embodiments, and other embodiments notspecifically described herein, will be apparent to those of skill in theart upon reviewing the above description.

The Abstract of the Disclosure is provided to comply with 37 C.F.R.§1.72(b), requiring an abstract that will allow the reader to quicklyascertain the nature of the technical disclosure. It is submitted withthe understanding that it will not be used to interpret or limit thescope or meaning of the claims. In addition, in the foregoing DetailedDescription, it can be seen that various features are grouped togetherin a single embodiment for the purpose of streamlining the disclosure.This method of disclosure is not to be interpreted as reflecting anintention that the claimed embodiments require more features than areexpressly recited in each claim. Rather, as the following claimsreflect, inventive subject matter lies in less than all features of asingle disclosed embodiment. Thus the following claims are herebyincorporated into the Detailed Description, with each claim standing onits own as a separately claimed subject matter.

1. A computer readable medium containing computer executable instructions that when executed by a computer perform a method, the method comprising: receiving trick play command data at an end user device; receiving advertising data at the end user device; correlating the advertising data with penetration data for an end user associated with the end user device; prioritizing the advertising data for the end user device based on the correlation; and presenting a portion of the advertising data in a picture in picture display window on the end user device based on the prioritizing of the advertising data during execution of the trick play command data.
 2. The method of claim 1, wherein the advertising data further comprises advertising data keys.
 3. The method of claim 2, wherein the penetration data further comprises at least one data set selected from the group consisting of advertising forwarding data and advertising discussion data for the end user.
 4. The method of claim 2, wherein the penetration data further comprises penetration effectivity data based on impression quality factors for the advertising data forwarded by the end user.
 5. The method of claim 4, wherein the correlating further comprises finding a penetration data category that matches one of the advertising data keys.
 6. The method of 2, wherein the advertising data further comprises penetration category data for correlating with subscriber activity data for the end user.
 7. A system comprising: a processor in data communication with a computer readable medium; and a computer program embedded in the computer readable medium comprising computer executable instructions for execution by the processor, the computer program comprising instructions to receive trick play command data at an end user device, instructions to receive a advertising data at the end user device, instructions to correlate the advertising data with penetration data for an end user associated with the end user device, instructions to prioritize the advertising data for the end user device based on the correlation and instructions to present a portion of the advertising data in a picture in picture display window on the end user device based on the prioritizing of the advertising data during execution of the trick play command data.
 8. The system of claim 7, wherein the advertising data further comprises advertising data keys.
 9. The system of claim 7, wherein the penetration data further comprises at least one data set selected from the group consisting of advertising forwarding data and advertising discussion data for the end user.
 10. The system of claim 7, wherein the penetration data further comprises penetration effectivity data based on impression quality factors for the advertising data forwarded by the end user.
 11. The system of claim 10, wherein the instructions to correlate further comprise instructions to find a penetration data category that matches one of the advertising data keys.
 12. The system of 8, wherein the penetration data further comprises penetration category data for correlating with subscriber activity data for the end user.
 13. A computer readable medium, containing a data structure for containing data useful in sending advertising data, the data structure comprising: a first field for containing data indicative of a trick play command data for execution at an end user device; and a second field for containing data indicative of prioritized advertising data based on advertising penetration data for an end user associated with the end user device for presentation in a picture in picture display window at the end user device during execution of the trick play command data.
 14. The medium of claim 13, the data structure further comprising: a third field for containing data indicative of the advertising penetration data for the end user associated with the end user device.
 15. The medium of claim 14, the data structure further comprising: a fourth field for containing data indicative of advertising data key data for correlation with the advertising penetration data for prioritizing the advertising data.
 16. The medium of claim 15, the data structure further comprising a fifth field for containing data indicative of advertising forwarding data for advertising data forwarded by the end user device to other end user devices.
 17. The medium of claim 16, the data structure further comprising a sixth field for containing data indicative of advertising discussion data for advertising data discussed by the end user at the end user device with other end users at other end user devices.
 18. The medium of claim 17, the data structure further comprising a seventh field for containing data indicative of advertising penetration category data for the end user device. 